Composite Spin Liquid in Correlated Topological Insulator - Spin Liquid without 

Spin-Charge Separation 
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In this paper, we found a new type of insulator — composite spin liquid which can be regarded 
as a short range B-type topological spin-density- wave proposed in Ref. []J. Composite spin liquid is 
topological ordered state beyond the classification of traditional spin liquid states. The elementary 
excitations are the "composite electrons" with both spin degree of freedom and charge degree of 
freedom, together with topological spin texture. This topological state supports chiral edge mode 
but no topological degeneracy. 
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I. INTRODUCTION 

The Fermi liquid based view of the electronic proper- 
ties has been very successful as a basis for understand- 
ing the physics of conventional solids including metals 
and (band) insulators. For the band insulators, due to 
the energy gap, the charge degree of freedom is frozen. 
For magnetic insulators with spontaneous spin rotation 
symmetry breaking, the elementary excitations are the 
gapped quasi-particle (an electron or a hole) that carry 
both spin and charge degree of freedoms and the gaplcss 
spin wave (the Goldstone mode). For this case, the global 
symmetry is broken from SU(2) down to U(l). Thus the 
low energy effective model is an 0(3) nonlinear er-model 
(NLerM) that describes long wave spin fluctuations. 

However, in some special insulators with spin-rotation 
symmetry and translation symmetry, due to a big energy 
gap of electrons, the charge degree of freedom is totally 
frozen, emergent gauge fields and deconfined spinons (the 
elementary excitation with only spin degree of freedom of 
an electron) may exist. People call them quantum spin 
liquids^. People have been looking for quantum spin 
liquid states in spin models for more than two decades 
[3j-l5(. In particular spin models, the quantum spin liquids 
are accessed (in principle) by appropriate frustrating in- 
teractions. In general there exist three types of ansatz of 
spin liquid: SU(2), U(l) and Z 2 ^M- Th c three different 
states may have the same global symmetry, as conflicts 
to Landau's theory, in which two states with the same 
symmetry belong to the same phase. Since one cannot 
use symmetry and order parameter to describe quantum 
orders, a new mathematical object - projective symme- 
try group (PSG) - was introduced @, H| to characterize 
the quantum order of spin liquid states. 

Recently, people look for spin liquids in the general- 
ized Hubbard model of the intermediate coupling region, 
for example, the Hubbard model on the triangular lat- 
tice, the Hubbard model on the honeycomb lattice, the 
7r-flux Hubbard model on square lattice . And, the 
quantum spin liquid state near Mott transition (MI) of 



the Hubbard model on honeycomb lattice has been con- 
firmed by different approaches [9Hl5j . However, the na- 
ture of the spin liquid in the generalized Hubbard model 
of the intermediate coupling region is still debated. 



In this paper we found that there may exist another 
type of insulator with spin-rotation symmetry and trans- 
lation symmetry, of which the elementary excitation has 
both spin degree of freedom and charge degree of free- 
dom. We call it composite spin liquid. Composite spin 
liquid (SL) can be regarded as short range B-type topo- 
logical spin-density- wave (B-TSDW) which is beyond the 
classification of traditional spin liquid states. In a com- 
posite SL, there is no spin-charge separation : the el- 
ementary excitation is so-called " composite electron" - 
a spin one-half charge ±e object trapping a topological 
spin texture (skyrmion or anti-skyrmion) . In addition, 
the composite SL is a topological spin liquid state with 
chiral edge states. However, similar to the case of inte- 
ger quantum Hall state, composite SL has no topological 
degeneracy for the ground state. 



* Corresponding author; Electronic address: spkou@bnu.cdu.cn 



The paper is organized as follows. Firstly, we write 
down the Hamiltonian of the topological Hubbard model. 
Secondly we derive the effective 0(3) nonlinear a model 
with the Chern-Simons-Hopf (CSH) term to learn its 
properties. Next, chiral SL and composite SL arc found 
to be the ground state of the short range A- type topologi- 
cal spin-density-wave and short range B-type topological 
spin-density-wave, respectively. Finally, the conclusions 
are given. In addition we compare composite SL with 
other exotic quantum states including fractional quan- 
tum Hall states, spin liquids and topological insulators. 
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II. MODEL AND MEAN FIELD RESULTS 

The Hamiltonian of the topological Hubbard model on 
honeycomb lattice is given by[l|, 0, [13] 
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t and t' are the nearest neighbor and the next nearest 
neighbor hoppings, respectively. We introduce a complex 
phase (f>ij (\4>ij\ = §) to the next nearest neighbor hop- 
ping, of which the positive phase is set to be clockwise. 
U is the on-site Coulomb repulsion, fj, is the chemical po- 
tential and /x = U/2 at half-filling, e denotes an on-site 
staggered energy and is set to be 0.15t. 

In the non-interacting limit (U = 0) , the ground state 
is a Q = 2 topological insulator with quantum anomalous 
Hall effect (QAH) for t' > 0.0288f and a normal band 
insulator (BI) for t' < 0.0288i. At if = 0.0288i, the 
electron energy gap closes at high symmetry points in 
momentum space. As a result, third order topological 
quantum phase transition occurs between QAH and BI. 
See the dispersion of electrons for t' — 0.0288i in FIG.l. 

When we consider the on-site Coulomb interaction, 
the ground state can be an AF SDW order. We have 
calculated the mean field value of staggered magneti- 
zation M that represents AF SDW order of the topo- 
logical Hubbard model from the definition (c| CT Ci jCr ) = 
h(l + (— 1)VM) in Ref.[l|. Based on the mean field 
results, the phase diagram has been obtained in FIG. 7 
in Ref.[l[. From the phase diagram we get five differ- 
ent quantum phases: two are non-magnetic states with 
M = 0, BI and QAH, three are magnetic states with 
M 7^ 0, A- type topological AF SDW state (A-TSDW), 
B-type topological AF SDW state (B-TSDW), and trivial 
AF SDW state. 

Let's explain the quantum phase transitions for differ- 
ent regions of t'. For t' > 0.0288i, the quantum phase 
transition between a QAH and AF SDW order is al- 
ways second order. Thus when we raise the interac- 
tion strength U, due to the smoothly increasing of the 
staggered magnetization, the QAH state will turn into 
the A-TSDW after crossing a magnetic phase transition, 
then turn into the B-TSDW crossing a topological quan- 
tum phase transition, eventually turn into the trivial AF 
SDW state crossing another topological quantum phase 
transition. However, in the region of t' < 0.0288£, the 
quantum phase transition between a BI and AF SDW 
order is first order which is denoted by the black line in 
FIG. 7 in Ref.[l[. Due to the jumping of the staggered 
magnetization, the BI state will turn into B-TSDW di- 
rectly and eventually turn into the trivial AF SDW state 
crossing a topological quantum phase transition. In the 
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FIG. 1: (Color online) The dispersion of electrons for t' = 
0.0288t when U = 0. We can see clearly that in the high 
symmetry point the energy gap is zero and like a Dirac cone. 



limit t' — > 0, the BI state will change into the trivial 
AF SDW state directly and there is no topological state 
at all. For the case of t' = 0.0288£, it is a semi-metal 
for the weak coupling limit (U/t < 2.5) without electron 
gap. When we raise the interaction strength U, due to 
the smoothly increasing of the staggered magnetization, 
the semi-metal state will turn into the B-TSDW after 
crossing a magnetic phase transition, eventually turn into 
the trivial AF SDW state crossing a topological quantum 
phase transition. 



III. EFFECTIVE NLctM FOR MAGNETIC 
STATES 

For the topological Hubbard model on honeycomb 
lattice, there are three different magnetic states, A- 
TSDW, B-TSDW, and trivial AF SDW. A question here 
is whether these three SDWs with M =^ are real long 
range AF order. The non-zero value of M by mean field 
method only means the existence of effective spin mo- 
ments. It does not necessarily imply that the ground 
state is a long range AF order because the direction of 
the spins is chosen to be fixed along z-axis in the mean 
field theory. Thus we will examine the stability of mag- 
netic order against quantum spin fluctuations of effective 
spin moments based on a formulation by keeping spin 
rotation symmetry, a z fi ■ a. 

By replacing the electronic operators c] and Cj by 
Grassmann variables c* and Cj, in the magnetic state, 
we get the effective Lagrangian with spin rotation sym- 
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FIG. 2: The illustration of the relationship between AF order 
and quantum disordered state 



of the quantum disordered state, respectively (see below 
discussion). 

For the case of a < Air, we get solutions of the spin 
condensed no and spin gap m s at zero temperature: 



ft 9 \l/2 

n =1 ) i , 

9c 



0. 



(5) 



At finite temperature, the solutions become Uq = and 



m s = 2fcBTsinh~ ~|e £ 
ergy scale of the spin gap m 
than the temperature, i.e., m 



sinh( 2 ^ rp )] . Because the en- 



2k B T> 

is always much smaller 
<C ks,T (or w n ), quantum 
fluctuations become negligible in a sufficiently long wave- 
length and low energy regime (m s < |cq| < k^T) . Thus 
in this region one may only consider the purely static 
(semiclassical) fluctuations. The effective Lagrangian of 
the NLcrM then becomes 



^ (Vn) 2 



(6) 



metry as 

C eS = c *adrC la ~ t ^ {c* a C ]a + h.C.) 

-t' £ e^clcjc -^(-l)' AMcl^aa* 

+ £ ^ ] c ier c io" ~ e ^ ] c ia c i<y (2) 

Where Am = UM/2, Within the Haldane's mapping, the 
spins are parametrized as fij = (— fVru %/l — L 2 +L,fl8r- 
[23l |. Here is the Neer vector and | | = I, L, is the 
transverse canting field, which is chosen to Lj ■ rij = 0. 

Then we integrate fcrmions and the transverse canting 
field and obtain the effective NLcrM as 



£n=^[- (d r n) 2 + C ( V n) 2 ] 
Ig c 



(3) 



with a constraint n 2 = 1. The coupling constant g and 
spin wave velocity c arc defined as 



x 1 



(4) 



Here p s is the spin stiffness and \ ± is the transverse 
spin susceptibility The detailed calculations are given in 
Appendix. A. 

The properties of the effective NLcrM are deter- 
mined by the dimcnsionlcss coupling constant a = gA. 
The cutoff is defined as the following equation A = 
min(l, AE/c). Here AE is the energy gap of electrons. 
In particular, there exists a critical point a c = An (or 
g c =-£■). See illustration of FIG. 2. The quantum critical 
point (QCP) separates the long range spin order from the 
short range spin order (the quantum disordered state). 
The dotted line shows the renormalized spin stiffness of 
the long range spin order and the energy scale of spin gap 



is the renomalized spin stiff- 



wherc p S:Cff = c f| - ^ 

ness. At zero temperature, the mass gap vanishes which 
means that long range AF order appears. To describe the 
long range AF order, we introduce a spin order parameter 



M = —n = - 1-f Va, 
2 2 g c 



0. 



(7) 



The ground state of long range AF ordered phase has 
a finite spin order parameter. And in this region there 
are two transverse Goldstone modes, between them the 
interaction is irrelevant. 

For the case of a > Att, the interaction between Gold- 
stone modes becomes relevant and at low energy the 
renormalized coupling constant diverges. Consequently, 
the spin gap opens and the long range spin order disap- 
pears which mean that the ground state may be a quan- 
tum disordered state, and we get the effective model of 
massive spin- 1 excitations 
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with the solutions of no and m s as 

. 1 1. 

no = 0, m s — Attc( ). 

9c 9 

Using the CP(1) representation, we have 



C s = - [1(3,, - ia ll )z\ 



m?z 2 l 



(8) 



(9) 



(10) 



where z is a bosonic spinon, z = [z\, Z2) , n.; = z.;crzj, 
zz = 1, a,, = — |(z9^z — df^zz). Here a M is introduced 
as an assistant gauge field. Specifically the local gauge 
transformation is z — > e lip ^ r ' T ^z. m z denotes the mass 
gap for spinons as m z ~ m s /2. 
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FIG. 3: (Color online) The phase diagram: there are seven 
phases, QAH, band insulator, A-TSDW, B-TSDW, chiral- 
spin-liquid, composite spin liquid and trivial AF-SDW. The 
regions of chiral spin liquid and composite spin liquid are the 
quantum disordered regions of a > 4ir. 
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FIG. 4: (Color online) The dimensionless coupling constant 
a = gA for the case of the parameter as if = O.lt. For the 
region with a > 4n, the ground state is chiral spin liquid 
(yellow region). 



In addition, after integrating over fermions by using 
gradient expansion approach we also obtain the Chern- 
Simons-Hopf (CSH) term as QUI 



CSH 



4-7T 



I.J 



Id, 



where K, is 2-by-2 matrix, 1 = and 



1=2 



(11) 



A. 



different /C-matrices : for A-TSDW order, K = 



for B -TSDW order, K = 



for trivial SDW order, 



is the electric- magnetic field. The "charge" of A^ and a M 
are defined by q and q s , respectively. Thus for different 
SDW orders with the same order parameter M, we have 

2 

x° 2 

1 1 1 
1 1 

K = 0. See detailed calculations in Appendix. B. 

For different regions of if, we calculated the dimen- 
sionless coupling constant g (a) and derived the quantum 
phase transitions between long range AF SDW order and 
short range one. Thus we can plot a new phase diagram 
in FIG. 3 that shows the quantum disordered regions of 
a > 4-7T (The regions of chiral spin liquid and composite 
spin liquid). 

For a given if bigger than 0.0288t, there are two sit- 
uations. FIG. 4 shows the dimensionless coupling con- 
stant for one situation with the parameter t' — OAt. 
In FIG. 4 there exists a quantum disordered region with 
a > a c = An in A-TSDW that corresponds to the chi- 
ral spin liquid (yellow region). The other case is shown 
in FIG. 5, of which the dimensionless coupling constant 
for the parameter t' = 0.033t. There are two quantum 
disordered regions with a > a c = Air: one corresponds 
to the chiral spin liquid (yellow region) in A-TSDW, the 
other is composite spin liquid (green region) in B-TSDW 
(see discussion in following sections). For this case, we 



Chiral spin liquid 



Composite 

spin liquid ^ 
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FIG. 5: (Color online) The dimensionless coupling constant 
a = gA for the case of the parameter as t' = 0.033£. For the 
regions with a > 4n, the ground states are spin liquid states 
- chiral spin liquid (yellow region) or composite spin liquid 
(green region). 



get the energy gap of spin order parameter A4q and spin 
excitations m s in FIG. 6 and FIG. 7. One can see that 
in chiral spin liquid and composite spin liquid, Mo = 0, 
m s 0. For the case of if = 0.0288t, we show the result 
of the dimensionless coupling constant in FIG. 8, from 
which one can see that there exists a quantum disordered 
region with a > a c = 4-7T in B-TSDW that corresponds 
to the composite spin liquid (green region) . For this case, 
we also get the energy gap of spin order parameter A4q 
and spin excitations m s in FIG. 9 and FIG. 10. One can 
see that in composite spin liquid, Mo = 0, m 8 ^ 0. 
For a given if smaller than 0.0288t, there are also two 
situations. For 0.02377i < t' < 0.0288i (f = 0.025i) , 
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FIG. 6: (Color online) The spin order parameter Mo for the 
case of the parameter as t' = 0.0334. Yellow region denotes 
chiral spin liquid and green region denotes composite spin 
liquid, of which Mo = 0. 



FIG. 8: (Color online) The dimensionless coupling constant 
a = gA for the case of the parameter as t' — 0.02884. For the 
region with a > An, the ground state is composite spin liquid 
(green region). 
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FIG. 7: (Color online) The spin gap m s for the case of the 
parameter as t' = 0.0334. Yellow region denotes chiral spin liq- 
uid and green region denotes composite spin liquid, of which 
m s / 0. 



from the result shown in FIG.ll, we found a quantum 
disordered region with a > a c = 4ir in B-TSDW that 
corresponds to the composite spin liquid (green region). 
For < t' < 0.023774 (f = 0.024) , we found that the 
dimensionless coupling constant a is always smaller than 
a c = 4ir. That mean there doesn't exist quantum dis- 
ordered region at all. We also plot FIG. 12 to show this 
situation. 

In the following parts we will use the effective model 
with CSH terms to learn the properties of different SDW 
orders [l|, 

•£eff = £ s + £csh 



FIG. 9: (Color online) The spin order parameter Mo for the 
case of the parameter as t' = 0.02884. The green region de- 
notes composite spin liquid, of which Mo = 0. 

where 

£ s = i[(5,n) 2 + my] 

and 

r — \ " KlJ ^a„j a j 

L-CSH - 2^ ~^~ £ a ^ a \- 

Thus an important issue is that what's the nature 
of these quantum disordered states with different CSH 
terms. Our answer is : for the case of A-TSDW with 

K = ( ^ 1 i the quantum disordered state is a chi- 
ral spin liquid with topological degeneracy and anyonic 
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FIG. 10: (Color online) The spin gap m s for the case of the 
parameter as t' = 0.0288t. The green region denotes compos- 
ite spin liquid, of which m s 7^ 0. 
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FIG. 12: (Color online) The dimensionless coupling constant 
a = gA for the case of the parameter as t' = 0.02f . We can see 
that the dimensionless coupling constant a is always smaller 
than a c = 4ir. That mean there doesn't exist quantum disor- 
dered region at all. 




FIG. 11: (Color online) The dimensionless coupling constant 
a = gA for the case of the parameter as t' — 0.025£. For the 
region with a > 4ir, the ground state is composite spin liquid 
(green region). 



excitations (See illustration of FIG. 13); for the case of B- 
1 1 



TSDW with K 



1 1 



the quantum disordered state 



is composite spin liquid with chiral edge states, of which 
the elementary excitation is spin one-half charge ±e ob- 
jects trapping a topological spin texture (See illustration 
of FIG.15). 
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FIG. 13: The illustration of the relationship between A- 
TSDW and chiral spin liquid 



IV. CHIRAL SPIN LIQUID - QUANTUM 
DISORDERED STATE OF A-TSDW 

Firstly, we study the quantum disordered state of A- 
TSDW that is described by 



£ ff 
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Cos = - [Kfy - ia^)z\ 2 + m 2 z z 2 ] 

Z7T ZTT 



(12) 
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At low energy limit, the kinetic term of gauge field 
is induced 

1 2 

C M = -7-2 ( d » a v) ■ ( 13 ) 

The induced coupling constant of three dimensional 
gauge field is e 2 = "iirm 2 z . After considering the CSH 
term, we have the effective Lagrangian as 

Ae 2 a 2tt 
+ ^- e ^ x A„d v A x . (14) 

For the compact U(l) gauge theory in 2+1 dimen- 
sions, there exist the instantons (space-time 'magnetic' 
monopolcs) that generate 2ir gauge flux of indicates 
that gauge field is 'compact' [2^]. Without the CSH 
term, the monopoles form Coulomb gas in 2+1 dimen- 
sions. Due to the Debye screening in the monopolc 
plasma, the gauge field a M obtains a mass gap and bosonic 
spinons z that couple the gauge field a M are confined. 
And it is pointed out in Ref.[27| that from the Berry 
phase of path integral of spin coherent state on honey- 
comb lattice, the ground state with spinon-confinement 
is really a VBS state with spontaneous translation sym- 
metry breaking. 

However, due to the Chern-Simon term, 
■^e^ x a fl d l/ a\, the instantons are confined by lin- 
ear potential and irrelevant to low energy physics. Thus 
the ground state cannot be VBS state and spinons 
are deconfincd. In particular, the Chern-Simons term 
for has a nontrivial statistics effect. Because the 
low energy physics is dominated only by spinon z, due 
to ■^e* lvX a ll d v a\, the statistics angel of z is 7r/2. As 
a result, spinons z becomes a semionic particle with 
spin J = jl Therefore the quantum disordered state of 
A-TSDW that is described by the effective Lagrangian in 
Eq.[l2] is really a topological ordered state - chiral spin 
liquid. From the CSH term, one may derive topological 
degeneracy - two degenerate ground states of chiral spin 
liquid on a torus [28|. The result is consistent to that in 
Ref.[l7|. 

In addition, one can also derive the edge states from 
the effective CSH theory. There are two right-moving 
"spin" edge excitations described by the following ID 
fermion theory [29j 

£cd gc = ^2i'l s (dt - v R d x )ip as , 

a 

where a = 1, 2. ?p as carries a unit of a p charge. One can 
see "spin" chiral edge states in FIG. 14 (the lines with 
arrows). Correspondingly, one can get the quantized spin 
Hall conductivity 

1 2e 2 
<7 S = Urn — dj (J sl (u;,0)J S j(-uj,0)} = —. (15) 

Here J s j denotes spin current, J s , = — i(^2 a V'aTiH ■ 0"^> a ). 



Chiral spin liquid 



FIG. 14: (Color online) The illustration of the edge state of 
chiral spin liquid. There exist "spin" chiral edge state (the 
lines with arrows) and "charge" chiral edge state (the lines 
with dots). 



On the other hand, we discuss the properties of A^. 
The gauge field A^ is classical field and has no dynamic 
terms. Thus the Chern-Simons term for A^ only indi- 
cates quantized anomalous charge Hall effect. From it, 
we find two right-moving branches of " charge" edge exci- 
tations, which are described by the following one dimen- 
sion fermion theory [30lj 

£edge = y^V4,c«(dt - Vc9 x )tpc,a, (16) 
a 

where a, (3 = 1,2. ipc.a carries a unit of A^ charge. One 
can see " charge" chiral edge state (the lines with dots) in 
FIG. 14. Consequently, we get the quantized charge Hall 
conductivity <th = ^tt- 

Finally, we identify the quantum disordered state of A- 
TSDW characterized by g > g c to be a chiral spin liquid 
with quantum anomalous Hall effect (See illustration of 
FIG. 13). For this system, there exists spin-charge sepa- 
ration. In FIG. 13, the QCP at g = g c denotes the quan- 
tum phase transition dividing long range A-TSDW and 
short range A-TSDW (chiral SL). In addition, we should 
emphasis the existence of the chiral spin liquid due to 
strongly fluctuated spin moments characterized by the 
diverge behavior of the spin coupling constant near the 
quantum phase transition (yellow region) in FIG. 4 and 
FIG. 5 as g — > g c . Thus the existence of the chiral spin 
liquid is independent on the cutoff A. 



V. COMPOSITE SPIN LIQUID - QUANTUM 
DISORDERED STATE OF B-TSDW 

Next we study the quantum disordered state of B- 
TSDW that is described by the low energy effective La- 
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i_ e nv\ a ^Q^ a ^ p rom ^ we can see that the spinons are 
fermionic particle by binding a 2tt flux of a M that is just 
a skyrmion (or an anti-skyrmion) . On the other hand, 

^e^A^ax, a 
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g 



FIG. 15: The illustration of the relationship between B- 
TSDW and composite spin liquid. 



Composite spin liquid 



due to the mutual Chcrn-Simons term ^-e^ x A,,d, 



2tt flux of will carry a electric charge. Thus z particle 
is really an "electron" or a "hole" binding a skyrmion 
(or anti-skyrmion). In the following parts we call such 
composite object "composite electron (hole)" . 

Due to the Chern-Simon term j^e tl ' jX a tl d v a\, the in- 
stantons are also confined by linear potential and irrel- 
evant to low energy physics. Thus the spinons are also 
deconfined. FIG. 17 shows the mass gap of z particle for 
the parameter t' = 0.033i, 2m z = Aitc(j — ~). One can 
see that m z is always much smaller than the mass gap of 
electrons, AE as m z -^i AE. So the low energy physics is 
dominated by z particle, the so-called composite electron 
(hole). 

Secondly, we study the properties of gauge fluctua- 
tions. After integrating the massive z particle, the ef- 
fective Lagrangian for gauge field becomes 

Cos = -^{d^Ov) 2 + -^-e tlvX a^d v a\ 
4e^ 47T 

+ J-e^^cUA + ^-e^ x A^A x . (17) 

ZTT 47T 



Then the partition function of the effective model is writ- 
ten as 



Z = / V[a]t 



Si drC ett 



Then we introduce a+ iM = A^ 
get the partition function as 



,n = A^ - a M and 



Z = J V[a+]e-^ dTC ^, 



FIG. 16: The illustration of the edge state of composite spin 
liquid. There exists a single chiral edge mode. 



where 



£ e ff = ^(^a„,+) 2 + ^ vX a^ + d v a x ,+. (18) 



grangian 



1 

4V 



^-e^A^ax + ^-e^a^ax 

ZTT 4:TT 



£ c ff = - [| (<9 P 



\ 1 2 i 2 21 

ia„. z +m,z 



+ ^-e^A^ax + ^-e^ x A^A x + ^-e^a^ax. 
2tt An An 



With the Chern-Simons term j^e fJ,l,x a flt+ d v ax y +, the 
gauge field a^ -+ indicates quantized spin-charge synchro- 
nized edge states and quantized spin-charge synchro- 
nized Hall effect pointed out in Ref. PJ . The edge excita- 
tion is described by the following one dimension fermion 
theory^ HI 



£ e dge = ft(d t ~ Vd x )lp 



(19) 



where -0 carries a unit of a +iM "charge". One can see a 
chiral edge mode (the lines in FIG. 16). Consequently, we 
get the spin-charge synchronized Hall conductivity as 



From FIG. 15, one can find that there indeed exist a re- 
gion of short range B-TSDW order that is characterized 
by 9 > g c - 

Firstly, we study the statistics of spinon z. To learn 
the statistics of spinon z, we can set A^ to be zero due to 
A^ is a classical field. Thus the CS term is reduced into 



1 / ~ - \ e 

Urn -eij {Ji{w, 0) Jj(-u, 0)j = — (20) 



where 



Ji = i(^2ipali{l ~ n • a)ip a /2). 



(21) 
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skyrmion 



FIG. 17: (Color online) The charge energy gap for case of t' — 
0.033f, e = 0.15t: the charge carrier is composite electron. 
In composite SL, the charge energy gap is that of spin gap, 
m s ; in B-TSDW, the charge energy gap is that of a pair of 
skyrmion and anti-skyrmion, A c . The energy gap of fermion 
quasi-particles are very big (see inset). 



FIG. 18: (Color online) The illustration of composite spin 
liquid, of which the elementary excitations are the " composite 
electrons" that are 5=1/2 charge ±e fermions with trapping 
a topological spin texture. 



Finally we use the duality relationship between spinons 
and skyrmions to learn the quantum phase transition at 
g = g c dividing long range B-TSDW and short range 
B-TSDW (composite SL). 

In B-TSDW, we can define the skyrmion 
(or anti-skyrmion) with winding number Q = 
J d 2 r Aren„ A n s • d u n s x d x n s 
lutions in the continuum limit are |32| 



±1, of which the so- 



_ \(x - x Q ) Hy-yo 

Us — ( i io . ^ i ^ 



± 



r-r | 2 + A 2 ' |r-r | 2 + A 2 ' 
A 



(22) 



|r-r | 2 + A 2 



)■ 



Here A is the radius of the skyrmion at r n = (xq, yo). In 
long range B-TSDW, due to "spin-charge synchronized 
charge-flux binding" effect, Q = ±1 skyrmion carries a 
unit electric charge q = =Fl and a unit "charge" q s = =pl. 
With a unit "charge" q s , a Q = ±1 skyrmion gets half 
spin and becomes a charged 5=1/2 fermion. 

The mass of the skyrmion (or anti-skyrmion) is asso- 
ciated with 



^skyrmion ^anti-skyrmion 



Ps,otf 



J d 2 r (Vn s ) 2 = 47r / 9 SjCff 



where p s . c s = (1 — jf)Ps- This result indicates the charge 
gap is really the mass gap of a pair of skyrmion-anti- 
skyrmion 

A c — ?7lskyrmion ~\~ ^anti— skyrmion — 87r(l )/? s (23) 

9c 

that will close at the critical point g = g c , A c — > 0. 
From FIG. 5, one can see that there exists two QCPs (g — 



g c ) between B-TSDW and composite SL, at which the 
charged excitations have no energy gap, while the usual 
electrons without trapping spin texture still has big mass 
gap AE > A c (see inset of FIG. 17). In B-TSDW, the 
low energy charge dynamics is dominated by fermionic 
charged skyrmions rather than the electrons. At these 
QCPs, the system is a semi-metal with gapless charge 
excitations. The dotted line in FIG. 15 is the energy scale 
of the charge gap. 

Finally we find that there exists a new type of spin 
liquid - composite spin liquid. The low energy excitations 
are "composite electrons" that are 5=1/2 charge ±e 
fermions with trapping a topological spin texture. See 
illustration in FIG. 18. At the QCPs between long range 
B-TSDW and composite SL, the system becomes a semi- 
metal with gapless charge excitations (even for gapped 
electrons). 



VI. CONCLUSION AND DISCUSSION 

In the end, we give a summary. We found a new type 
of topological state which we name as composite spin 
liquid. Composite spin liquid state can be regarded as a 
short range B-type topological spin-density- wave which is 
beyond the classification of traditional spin liquid states. 
For traditional spin liquid states, there always exists spin- 
charge separation. While for composite spin liquid there 
is no spin-charge separation. Instead, the elementary ex- 
citations are " composite electrons" with both spin degree 
of freedom and charge degree of freedom, together with 
topological spin texture. This topological state supports 
single chiral edge mode but no topological degeneracy. 
In addition, the QCPs between long range B-TSDW and 
composite SL are also nontrivial, at which the system be- 
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charge +e/3 
anyon 



comes a semi-metal with gaplcss charge excitations (even 
for gapped electrons). 



FIG. 19: (Color online) The illustration of Fractional quan- 
tum Hall state. Small blue balls with single arrow denotes 
the anyonic excitations with ±e/3 charge. 




S=l/2 chargeless 
spinon 



FIG. 20: (Color online) The illustration of quantum spin liq- 
uid. The blue arrows denote an S = 1/2 chargeless spinons. 



In addition, we give a comparison on different exotic 
quantum orders beyond Landau's theory: 



Fractional quantum Hall (FQH) state : due to 
charge- flux binding effect, the elementary exci- 
tations arc anyonic excitations with fractional 
electric charge and fractional quantized Hall 
conductivity [3-H |35| . FIG. 19 shows the anyonic ex- 
citations with ±e/3 charge (small blue balls with 
single arrow). The ground state on a torus has 
topological degeneracy. For the open system, there 
exist chiral edge states on its boundary. By their ef- 
fective CS theories (or K- matrix theory [2 EH, H3] ) , 
people can classify fractional quantized Hall states 
into different Abelian states and nonAbelian states; 



2. Topological band insulator (TBI) : the elementary 
excitations arc gapped electrons (or holes) . For this 
topological state, there exist gapless edge states. 
However, there is no topological degeneracy for the 
ground state. By "ten- fold way" of random matrix, 
people classify topological band insulators into Z2 
type or Z typejjjSfiij; 

3. Spin liquid (SL) : due to the big electron gap (Mott 
gap), the excitations are deconfined spinons with 
only spin degree of freedom. In FIG. 20, the blue 
arrow denotes an S = 1/2 chargeless spinon. By 
PSGs, people classify quantum spin liquid states 
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Excitations Topolof 


;ical dej 


jeneracy Edge state Classification 


FQH state 


Charged anyon 


Yes 


Yes 


K-matrix 


TBI 


Electron 


No 


Yes 


Ten-fold way 


SL 


Spinon 






PSG 


Composite SL 


Composite electron 


No 


Yes 


? 



TABLE I: The differences (the types of excitations, if there exists topological degeneracy for the ground states on torus, if 
there exist edge states, the way to classify the topological states) between four exotic quantum orders beyond Landau's theory: 
fractional quantum Hall state(FQH), topological band insulator (TBI), spin liquid (SL), composite spin liquid (SL). 



into SU(2) type, £7(1) type or Z 2 typed El- For 
topological spin liquid (for example chiral spin liq- 
uid), there exist gapless edge states and topological 
degeneracy; while for gapless spin liquid (for exam- 
ple algebraic spin liquid), there is no well defined 
gapless edge states and topological degeneracy. For 
this reason we use "— " to denote the uncertainty 
in table. 1; 



4. Composite spin liquid : the elementary excitations 
are the "composite electrons" with both spin de- 
gree of freedom and charge degree of freedom, to- 
gether with topological spin texture (See FIG. 18). 
For this topological states, there exist gapless edge 
states but no topological degeneracy. Till now we 
don't know how to characterize composite spin liq- 
uid states. For this reason we use "?" to denote the 
situation in table. 1. 



Finally, we address the relevant experimental realiza- 
tion. This topological Hubbard model on honeycomb lat- 
tice may be simulated in optical lattice of cold atoms. In 
Ref. [33[ , it is proposed that the (spinless) Haldane model 
on honeycomb optical lattice can be realized in the cold 
atoms. When two-component fermions with repulsive in- 
teraction are put into such optical lattice, one can get an 
effective topological Hubbard model. It is easy to change 
the potential barrier by varying the laser intensities to 
tune the Hamiltonian parameters including the hopping 
strength (i-term), the staggered potential (e-term) and 
the particle interaction ([/-term). 



Acknowledgments 

This work is supported by NFSC Grant No. 10874017, 
11174035, National Basic Research Program of China 
(973 Program) under the grant No. 2011CB921803, 
2012CB921704, 2011cba00102. 



VII. APPENDIX A: THEORY OF SPIN 
FLUCTUATIONS - TO GET THE 0(3) 
NONLINEAR a MODEL 

The Hamiltonian of the topological Hubbard model on 
honeycomb lattice is given by 

i i,<7 
ieA,a i£B,cr 

t and t' are the nearest neighbor and the next nearest 
neighbor hoppings, respectively. We introduce a complex 
phase (j>ij (\(j>ij \ = f) to the next nearest neighbor hop- 
ping, of which the positive phase is set to be clockwise. U 
is the on-site Coulomb repulsion, a are the spin-indices 
representing spin-up (a =|) and spin-down (er =!) for 
electrons, e denotes an on-site staggered energy and is 
set to be 0.15i. . 

For free fermions (the on-site Coulomb repulsion U is 
zero), the spectrum 

£k = \J\Zk\ 2 + (? k +e) 2 (25) 

where 



|Ck| = tJ 3 + 2 cos {VSky) + 4 cos (3k x /2) cos {VSk y /2) 
and 

&=2f^sin(k.b0. (26) 

i 

Where is the nest nearest vectors. According to this 
spectrum E^, we can see that there exist energy gaps 
A/i, A/2 near points ki = -^(1, l/VS) and k 2 = ^(1, 
1/V3) as A/i = \2e-6V3t'\ and A /2 = 2s + 6^/3*', 
respectively. There exist two phases separated by the 
phase boundary 2e = 6y/3t' , the quantum anomalous 
Hall (QAH) state and the normal band insulator (BI) 
state with trivial topological properties. 

Because the Hubbard model on bipartite lattices is 
unstable against antifcrromagnctic instability, at half- 
filling, the ground state may be an insulator with AF- 
SDW order with increasing interacting strength. Such 
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AF-SDW order is described by the following mean field 
order parameter ((— l) l ct<7 z Cj) = M. Here M is the 
staggered magnetization. In the mean field theory, the 
Hamiltonian of the topological Hubbard model is ob- 
tained as 



H MF =H- ^(-tfAM&UA 



(27) 



where Am = ^5— . Then in the momentum space we get 



(28) 



where c\ = (c^.cj^.cj^.cj^) and 

(7M 



-o. + e 



-6. 



cr, - e 



After diagonalization, we can get the quasi-particles spec- 
trums 



E kl =±J(C k + A M +s) 



and 



s k2 = ±V(^-A M +£) 2 + iai 2 - 



(29) 



(30) 



By minimizing the ground state's energy, the self- 
consistent equation in the reduced BZ is reduced into 



1 



1 



E 



&- Am+£ 
2i? k2 



(31) 



where iV s is the number of unit cells. The phase dia- 
gram has been obtained in Ref. [l[ . There are totally five 
phases, NI state, QAH state, A-TSDW state, B-TSDW 
state and trivial AF-SDW state seperated by two types of 
phase transitions : one is the magnetic phase transition 
[denoted by (U /£)m] between a magnetic order state with 
M 7^ and a non-magnetic state with M = 0, the other 
one is the topological quantum phase transition [denoted 
by (y)c1 or (y)c2] that is characterized by the condition 
of zero fermion's energy gaps, A/i = — 6\/3t'+2e+UM = 
or A/2 = 6V3i' + 2e - UM = 0. 

We deal with the spin fluctuations by using the path- 
integral formulation of electrons with spin rotation sym- 
metry. The interaction term can be handled by using the 
SU(2) invariant Hubbard- Stratonovich decomposition in 
the arbitrary on-site unit vector S~2^ 



-[fli-clacif 



(32) 



Here a = (cr x , cr y , a z ) are the Pauli matrices. By replacing 



c* and Cj , the effective Lagrangian of the 2D generalized 
Hubbard model at half filling is obtained: 

-t' ^ e 1 ^' 'C* i(T Cj a - A M ^2 cla-flt-o-Ci^ 

+ £ Cfoda-e ^2 C iad<r- ( 33 ) 

To describe the spin fluctuations, we use the Haldane's 
mapping: 



fli = (-L/rWl-Lf + L 



(34) 



where n, = (nf,nf,nf) is the Neel vector that corre- 
sponds to the long-wavelength part of 17^ with a restric- 
tion n 2 = 1. Li is the transverse canting field that cor- 
responds to the short-wavelength parts of with a re- 
striction Li • rii = 0. We then rotate 17, to z-axis for the 
spin indices of the electrons at i-site: 



1>i = U} Ci 
l/Jiii ■ aU l = o z 
Ullu ■ all, = L • a 



(35) 
(36) 
(37) 



where Ui eSU(2)/U(l). 

One then can derive the following effective Lagrangian 
after such spin transformation: 

£cff = ^2 ^i,« d ri>i,a + E ^i,<r a ° (*) ^> CT 

-t J2 i^ta^^ + h. C )-t' J2 ^^ij^^a 

+ e J2 J2 ^,/ iaii *^ 



ieA.tj 



ieB.a 



-A M j2rt 



(38) 



where the auxiliary gauge fields a^- = a.i^\o x + aij^y 
and ao (i) = ap,! (i) & x + ao,2 (*) &y are defined as 



= u}u j , a (i) = Ujd T U i , 



(39) 



In terms of the mean field result M = (—1)' (ip*(J z ipi) 
as well as the approximations, 



I 2 

i-i 2 ^i-^, e 



1 + ia 



1 j ■ 



the electronic operators c\ and cj by Grassmann variables we obtain the effective Hamiltonian as: 



13 



denoting di<fii= a and 9 T 0i = iB y . we have 



ieA,a 



(40) 



(49) 
(50) 

becomes 

£(5,,a) = -ic^ + ^ s a 2 . (51) 

Then one could get £ and /j s from the following equations 
by calculating the partial derivative of the energy 



The energy of Hamiltonian of Eq. (|4"Tj) becomes 



By integrating out the fermion fields ip* and if>i, the ef- 
fective action with the quadric terms of [ao (i) — Act ■ lj] 



_ 1 ggp (gg) 



and cijj becomes 



1 f' 3 ?A 2 
5cff = - jf oY ]T[-4,(a ■ LJ 2 +W 3 + -^1 2 ] 

(41) 

To give p s and c for calculation in detail, we choose Ui 
to be 



N dBl 

1 d 2 E (a ) 
9a 2 



B„=0 



a=0- 



(52) 
(53) 



(42) 



where = ZjCrZj, Zj = (z^, zq.) , ZjZ^= 1. And the spin 



rij = Zi+Re (<fo) x+Im (</>;) y 



1-1^1/8 
&/2 



O(0f). 



(43) 
(44) 



Then the quantities Ujl/j and l/Jd T Ui can be expanded 
in the power of cf>i — <pj and <9 r </>i, 

>-»— 

o ia r<i 



(45) 
(46) 



According to Eq. (|3T))) . the gauge field and ao (i) are 
given as 



«0 («) = -^d r (j)icr y . 



(47) 
(48) 



Supposing cijj and ao (i) to be a constant in space and 



Here -Eo {B y ) and £o (a) are the energy of the lower Hub- 
bard band 



k 



(54) 
(55) 



where k , E c _ k and k , k are the energies of the 
following Hamiltonian H> and H p 

H C = -t ]T (l/llrfaa + h.c) - t' J2 e< ^<^J,a 
<«,J>.ct {{i,j)),a 



i£B,a 



(56) 



-A M ^(-1)» 2 ^ (57) 



Using the Fourier transformation for 7^, we have the 
spectrum of the lower band of W^: 



s ±,k = — o V 4 l^fel 2 + 2a 2 + S 2 + 2d 2 ± 2Ja 4 + B 2 a 2 - 2a 2 d 2 + B 2 d 2 + 4B 2 |£ fe | 2 + d 4 + 2ad5 2 (58) 
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where a = £k' + ^jr + £ an d d — £k< — + e. Similarly, using the Fourier transformation for 'H p , we 

TT - „ i d' 2 E (B y ) | , have the spectrum of the lower band of W: 

Using q = —jj — — \B v =o and &o{£>y) = 

S ( E + k + E - k ) ' we can S ct ? to be 
k v ' ' 



— V— r 



2[4|g fc | 2 + ( Q +d) 2 
\/(a 2 -d 2 ) 2 



2 2[4|^| 2 + (q+d) 2 ] 



)• (59) 



v /a 2 + 2|6| 2 + rf 2 + V^-a 2 )^ 



= - - ^4|V>| 2 + 2G 2 - 4B 2 + 4|^| 2 + 2A 2 

±2(4\iP\ 2 G 2 -8AG\i/j\ 2 + 8ABt/j*(p (60) 

- 8AB(^*V> + 8B4>*tpG - 8<p*BipG - 2A 2 G 2 - 4((p*ip - ip*ip) 2 

- 8AGB 2 - 4G 2 B 2 + G 4 - 4B 2 A 2 + A 4 + 4A 2 |i/;| 2 J 2 I (61) 



where Using p s = i^si| a=0 and £ (a) 

„,/\-* A , x • /, , x £^ S (£+ k + k )) we can S et /°s = Psi + Ps2 where 

A = 2f'2^cos(-a-b i )sm(k-b i ) + s+— , k V + ' ' k ' 

/7M 



G = 2f' ^2 cos • bj) sin (k • bj) + e 

i 

B = — 20/ sin (—a • b^) cos (k ■ bj), 

i 

^ = -^ e lk ' 5 cos(ia. ( 5), 
V = -^ e ik ' 5 sin(ia- ( 5). 
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Psl 



= w E ( - m cos ( if } cos ( 4^ } - m ' ( 1 + cos { ^ ky ] sin2 ( IT ] 



- 9t'(P + Q) cos (^£) sin (^) + (3(i 2 ((P - Q) 2 + 6t 2 ) + 6i' 2 (P + Qf 

- 6(i 4 + i' 2 (P + Qf) cos (3* a )) - 4< 2 (P - Qf cos (^) cos (^^) 

+ (i 2 ((P - Q) 2 + 18t 2 ) - 18t'(P + Qf 
+ 18(i'(P + Q) 2 - t 4 ) cos (3fc x )) cos (V3k y ) 

- 9t'(P -Qf(P + Q) cos (^) sin (^) 

+ 72i 2 i'(P + Q) sin 2 (^) sin (V3fc„)) / V(P 2 - Q 2 ) 2 ) 

/8V2\fp~ 2 + Q 2 + 2|£ fe | 2 + v^P 2 - Q 2 ) 2 (62) 



and 



Ps2 = 



^ £ ( - 9t cos (^) cos (^) - 36f (-1 + cos (V3k y ) sin 2 (^) 



9t'(P + Q) cos (^) sin C^L) ~ (i{t 2 {{P - Qf + 6t 2 ) + 6t' 2 (P + Qf 



6(t 4 + t' 2 (P + Qf) cos (3k x )) - 4i 2 (P - Qf cos (^) cos (^2.) + (< 2 ((P - Qf + 18t 2 ) 



2 '"~ y 

- 18t'(P + Q) 2 + 18(t'(P + Qf - t 4 ) cos (3^)) cos {V3k y ) 



- 9t'(P - Qf(P + Q) cos (— -) sin (- 



•3U 

72t 2 t'(P + Q) sin 2 «) sin (V3k v ) / ^{P 2 - Q 2 ) 2 



/8V2J P 2 + Q 2 + 2|a-| 2 - v / (^ 2 " Q 2 ) 



(63) 



where P = £fc/ 
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In addition, we study the continuum theory of the ef- 
fective action. In the continuum limit, we denote rij, lj, 
idij ~ UjUj - 1 and a Q (i) = Ujd T Ui by n(x,j/), l(x,y), 
U^d x U (or WdyU) and U^d T U, respectively. From the 
relations between U'd^U and <9 M n, 



a 2 = a 2 a + < 2 = --(d T nf, r = 0, (64) 

a£ = a l,i + a l,2 = \i d n n ?i l* = x,V, (65) 
a o-l=-- ( n x d T n) • 1, (66) 



the continuum formulation of the action turns into 



S cS = - J drj d 2 r[s(d T n) 2 + Ps (ynf 

9 A 2 

- 4iA M C (n x d T n) ■ 1 + {-^- - 4A 2 ^)1 2 ] (67) 

where the vector ao is defined as ao = (ao,i, ao.2, 0) . 

Finally we integrate the transverse canting field 1 and 
obtain the effective NLctM as 



S e (£ - — 



d 2 r[- c (d T nf + c(yn) 2 ] (68) 



with a constraint n 2 = 1. The coupling constant g and 
spin wave velocity c are defined as: g = 



1 c 2 _ Ps 

PsX 1 - ' X 1 
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and x 1 ' is the transverse spin susceptibility 
X ± = k- 1 -2U}-\ 



(69) 



where U (r, r) is a local and time-dependent spin SU(2) 
transformation defined by 



In addition, we need to determine another important 
parameter - the cutoff A. On the one hand, the effective 
NLerM is valid within the energy scale of electrons's gap, 
AE. On the other hand, the lattice constant is a nat- 
ural cutoff. Thus the cutoff is defined as the following 
equation 



U' (r, t) n ■ all (r, r) 



. AE 

A = min(l, J. 

c 



(70) 



And is introduced as an assistant gauge field as 
icr^a^ ee t/ f (r, t) d^U (r, r) . 

An important property of above model in Eq. (|76[) is 
the current anomaly. The vacuum expectation value of 
the fermionic current 



J a,* = i^a^lpa,*) 



(77) 



VIII. APPENDIX B: INDUCED CSH TERMS 

In this appendix we will derive the low energy effective 
theory of (T-)SDW states by considering quantum fluc- 
tuations of effective spin moments based on a formulation 
by keeping spin rotation symmetry, a z — > n • a where n 

is the SDW order parameter, /cf<7Cj\ = Mn. 

On a honeycomb lattice, after dividing the lattice into 
two sublattices, A and B, the dispersion can be obtained 
from Eq.(2). In the continuum limit, the Dirac-like effec- 
tive Lagrangian describes the low energy fermionic modes 
near two points, ki = — ~t(^>^) an d ^2 = -f-(l, 
as 

Cf = ^ [i'tpalu ~ iA n) V'a + nialpalpa - SA M i' a Cr ■ nip a ] 



can be defined by 



Jaa = i{Y l [(iD + im a ^(iD + im atl7 )} \iD + im a .^} 

(78) 

where 



D = 7^0^ - iA^ + iaa^) 



(79) 



and the mass terms are m aiCT = m a — SAmc- The topo- 
logical current J£ a is obtained to be 

Jlo = ~^^ X (d„A x ad u a x ). (80) 

Then we derive the CSH terms as EH HI 



(71) 

which describes low energy charged fermionic modes a = 
1 near ki, 

i'i = ViJO = ( 0tlA, V'TIS, $11A, $11B ) (72) 
and a = 2 near k2, 

i'2 = Ipho = ( ^2B, $\2A, ^12B, $12A )• (73) 

The masses of two-flavor fermions are 

mi = s - 3\/3Y (74) 

and 

m 2 =£ + 3V3t'. (75) 

7 M is defined as 70 = a ® t z , 71 = <x <8> T y , 72 = cr ® t x 

with (To = ^ q ^ ^ . t x , T y , t z are Pauli matrices. 5 = 1 

for a = 1 and 5 = —1 for a = 2. We have set the Fermi 
velocity to be unit vp = 1. 

In CP 1 representation, we may rewrite the effective 
Lagrangian of fermions in Eq. (|71[) as 



To make an explicit description of SDWs, we introduce 
the /C-matrix formulation that has been used to charac- 
terize FQH fluids successfully [24j . Now the CSH term is 
written as 



I, J 



(82) 



,J=2 



where K. is 2-by-2 matrix, = A^ and 

The "charge" of A M and a M arc defined by q and g s , re- 
spectively. 

Thus for different SDW orders with the same order 
parameter M, we have different JC- matrices : for mi, 
m 2 > A M , 



K. 



for m 2 > Am > mi, 



= / , Tp'a (*7m^M + 7m - ln&3 a n + m a - S Am 0-3) ip' a 

a 

(76) 



2 
2 



1 1 
1 1 



(83) 



(84) 



with 



V'o ( r > T ) = U"> (r, t) ip a (r, t) 



for mi, to 2 < A A /, 

K = 0. (85) 
This results are consistent to those in Ref. [1]. 
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